Papers with RETURNN of attention models
RETURNN as a Generic Flexible Neural Toolkit with Application to Translation and Speech Recognition (P18-4)
Copied to clipboard
| Challenge: | Using RETURNN, we train and decode attention models for translation and speech recognition. |
| Approach: | They propose a layer-wise pretraining scheme for recurrent attention models and show its significant effect on deep recurrence encoder networks. |
| Outcome: | The proposed training and decoding scheme improves 1% on expected training and improves on WMT 2017 and Switchboard. |